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Abstract 

In this paper, we propose a direct solution method for optimal switching problems of one-dimensional 
diffusions. This method is free from conjectures about the form of the value function and switching 
strategies, or does not require the proof of optimality through quasi-variational inequalities. The direct 
method uses a general theory of optimal stopping problems for one-dimensional diffusions and charac- 
terizes the value function as sets of the smallest linear majorants in their respective transformed spaces. 

1 Introduction 



Stochastic optimal switching problems (or starting and stopping problems) are important subjects both in 
mathematics and economics. Since there are numerous articles about real options in the economic and 
financial literature in recent years, the importance and applicability of control problems including optimal 
switching problems cannot be exaggerated. 

A typical optimal switching problem is described as follows: The controller monitors the price of natural 
resources for optimizing (in some sense) the operation of an extraction facility. She can choose when to start 
extracting this resource and when to temporarily stop doing so, based upon price fluctuations she observes. 
The problem is concerned with finding an optimal switching policy and the corres pondin g value function. A 
number of papers on this topic are well worth rnentioning : Brennan and Schwarz (Il985h in conjunction with 
conven ience yield in the energy market. Dixit (|l989h f or pro duction facility problems, Brekke and 0ksendal 
(| 19941) for resource extractio n prob lems, Yushkevich (|200lh for positive recurrent countable Markov chain , 
and Duckworth and Zervos (1200 ih for reversible investment problems. Hamdadene and Jeanblanc (12004) 
analyze a general adapted process f or fini te time horizon using reflected stochastic backward differential 
equations. Carmona and Ludkovski (l2005h apply to energy tolling agreement in a finite time horizon using 
Monte-Carlo regressions. 

A basic analytical tool for solving switching problems is quasi-variational inequalities. This method is 
indirect in the sense that one first conjectures the form of the value function and the switching policy and 
next verifies the optimality of the candidate function by proving that the candidate satisfies the variational 
inequalities. In finding the specific form of the candidate function, appropriate boundary conditions includ- 
ing the smooth-fit principle are employed. This formation shall lead to a system of non-linear equations that 
are often hard to solve and the existence of the solution to the system is also difficult to prove. Moreover, 
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this indirect solution method is specific to the underlying process and reward/cost structure of the prob- 
lem. Hence a slight change in the original problem often causes a complete overhaul in the highly technical 
solution procedures. 

Our solution method is direct in the sense that we first show a new mathematical characterization of 
the value functions and, based on the characterization, we shall directly find the value function and optimal 
switching policy. Therefore, it is free from any guesswork and applicable to a larger set of problems (where 
the underlying process is one-dimensional diffusions) than the conv ention al methods. Our approach here 
is similar to Dayanik and Karatzas (l2003h and Dayanik and Egami (l2005h that propose direct methods of 
solving optimal stopping problems and stochastic impulse control problems, respectively. 

The paper is organized in the following way. In the next section, after we introduce our setup of one 
dimensional optimal switching problems, in section 12. 1[ we characterize the optimal switching times as 
exit times from certain intervals through sequential optimal stopping problems equivalent to the original 
switching problem. In section 12.21 we shall provide a new characterization of the value function, which 
leads to a direct solution method described in 12.31 We shall illustrate this method through examples in 
section m one of which is a new optimal switching problem. Section H] concludes with comments on an 
extension to a further general problem. 



2 Optimal Switching Problems 

We consider the following optimal switching problems for one dimensional diffusions. Let {Q,J^,F) be a. 
complete probability space with a standard Brownian motion W = {Wt;t > 0}. Let Zt be the indicator 
vector at time t, Zt G {zi, Z2, Zm} — Z where each vector Zj = (ai, 02, a^) with a is either (closed) 
or 1 (open), so that m = 2^^. In this section, we consider the case of A; = 1. That is, Zt takes either or 1. 
The admissible switching strategy is 

= (^'o; ^2, ^fci Co, Ci) C2, Cfc, •••) 

with 6*0 = where where where < ^1 < Q2 < are an increasing sequence of .Fr stopping times and (i, 
C2-" are -measurable random variables representing the new value of Zt at the corresponding switching 
times 9i (in this section, d = I or 0). The state process at time t is denoted by {Xt)t>o with state space 
X = (c, d) C M and Xq = x G X, and with the following dynamics: 
If Co = 1 (starting in open state), we have, for m = 0, 1, 2, , 

dXt = P^*' " f^iiX^)dt + ai{X^)dWt, ^2,n < t < 62^+1, ^2 

[dX? = fIo{X^)dt + aoiX'^)dWt, e2m+l < t < 02^+2, 

and if Co = (starting in closed state), 

dX? = fio{X^)dt + ao{X'')dWt, e2m<t< 
dXl = fii{X^)dt + ai{X^)dWt, 02^+1 < t < C2m+2- 



dXt 



(2.2) 



We assume that ^Uj : M ^ M and : M ^ M are some Borel functions that ensure the existence and 
uniqueness of the solution of (12.11 ) for i = 1 and (12.21 ) for i = 0. 
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Our performance measure, corresponding to starting state i = 0, 1, is 



poo ^ 



(2.3) 



where H iRx Z —>■ is the switching cost function and / : 



< oo. 



is a continuous function that satisfies 

(2.4) 



In this section, the cost functions are of the form: 



H{Xe-,C) 



H{Xg_, 1) opening cost, 
H{Xg_ , 0) closing cost. 



The optimal switching problem is to optimize the performance measure for i = (start in closed state) and 
1 (start in open state). That is to find, for both i = I and i = 0, 



Vi{x) = sup J^{x) with Xq = X 



(2.5) 



where W is the set of all the admissible strategies. 
2.1 Characterization of switching times 

For the remaining part of section 2, we assume that the state space X isZ = (c, d) where both c and d are 
natural boundaries of X. But our characterization of the value function does not rely on this assumption. In 
fact, it is easily applied to other types of boundaries, for example, absorbing boundary. 

The first task is to characterize the optimal switching times as exit times from intervals in M. For this 
purpose, we define two functions go and gi : IR+ M with 



gi{x) = sup Ji{x) and go{x) = sup Jq{x). 



(2.6) 



where Wq = {w €W : w = {Oq, Co, = +oo)}. In other words, gi{-) is the discounted expected revenue 
by starting with = 1 and making no switches. Similarly, gQ{-) is the discounted expected revenue by 
staring with Co = and making no switches. 

We set Wq = gi and yo = go. We consider the following simultaneous sequential optimal stopping 
problems with Wn : M+ — > M and y„ : ^ M forn = 1, 2, 



and 



res 



yn{x) = supE^ 
res 



e-'''f{Xs)ds + e-"^(2/„„i(X0 - H{Xr-, 1 - Z,_)) 



e-°V(^.)ds + e-""K_i(XO - H{X^^, 1 - Z,_)) 



(2.7) 



(2.8) 



where 5 is a set of J^t stopping times. Note that for each n, the sequential problem 1277] (resp. (12.81 )) starts in 
open (resp. closed) state. 
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On the other hand, we define n-time switching problems for = 1^ 



= sup Jf{x) 

W&Wn 



(2.9) 



where 



{w eW]w = (6*1, 6*2, ...6l„+i;Ci,C2, ...Cn);6'n+i = +oo}. 



In other words, we start with Co = 1 (open) and are allowed to make at most n switches. Similarly, we 
define another n-time switching problems corresponding to (^q = 0- 



^ sup J^{x). 



(2.10) 



We investigate the relationship of these four problems: 

Lemma 2.1. For any x G M, Wn{x) = q^"-\x) andyn{x) = p^^\x). 

Proof. We shall prove only the first assertion since the proof of the second is similar. We have set yo{x) 
go{x). Now we consider wi by using the strong Markov property of X: 



wi{x) = supE^ 
= sup E^' 

rG5 



roc roo 

e-'-'^f{Xs)ds- j e-^'fiX,)ds-e-^-igo{Xr)-HiXr-,0)) 



supE- [e-^-{goiXr) - gi{Xr) - //(X,-,0))] + gi{x) 



On the other hand, 

g(^)(x) = sup E^' 

= sup E^ 



POO 

/ e-'''fiX,)ds-e-'''^H{Xe,_,Ci 
Jo 

POD 

e-'''f{X,)ds+ / e~'''f{Xs)ds-e-''''H{Xg,_,0) 



sup E^' (5i(x) - e-'^'^giiXe,)) - e-''"H9o{Xe,) - H{Xe,_,0)) 

w<=Wi L 



sup E^ 



e-"^i (50 (Xe, ) - gi (Xe, ) - HiXg,. ,0)) +51 (x) . 



Since both r and 9i are J^t stopping times, we have wi{x) = q^^\x) for all x G M. Moreover, by the theory 
of the optimal stopping (see Appendix lAl especially Proposition IA.4I ). r and hence 9i are characterized as 
an exit time from an interval. Similarly, we can prove yi{x) = p^^\x). Now we consider q^'^\x) which is 
the value if we start in open state and make at most 2 switches (open — > close —>■ open). For this purpose, we 
consider the performance measure g(^) that starts in an open state and is allowed two switches: For arbitrary 
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switching times ^i, ^2 > G S, we have 

2 



qr(2)(2;) = sup E^ 
(91,02)652 



/>oo ^ 

rOi 1-02 roo 

JO Jei J02 

- e'''''HiXe,-,0) - e-''''HiXe2-,l) 

ffi(x) -E-[e-"^if/i(XeJ]) + (E-[e-^^5o(^eJ -e-"^^5o(^eJ]) +E^[e-°'^5i(^eJ] 

- E-[e-"^iF(Xe,_, 0) + e-"^2^(X,,_, 1)]. 

Hence we have the following multiple optimal stopping problems: 

e~"'^ ((50 - gi){Xe,) - H{Xe,-,0)) + e-'''^ ((51 - go){Xe,) - H{Xe,-, 1) 

where = {{Oi,62);0i E 5;02 S Sg-^} and 5o- = {r S 5;r > fi} for every a £ S. Let us denote 

hi{x) = gi{x) - go{x) - H{x,0), h-2{x) = go{x) - gi{x) - H{x, 1), 

Vi{x) = supE^' [e-"^/ii(X^)] and V2{x) = supE^ [e'"^ {h2{Xr) + Vi{Xr))] . 
We also define 

Ti^{x€l:Vi{x) = hi{x)} and r2 = {x e J : V2(x) = /i2(2;) + yi(x)} 

with an = inf{t > : € r„}. By using Proposition 5.4. in Carmona and Dayanik (I2OO3I), we conclude 
that 9i = o\ and 6*2 = ^1 + o"2 o 8(6*1) is optimal strategy where s(-) is the shift operator. Hence we only 
consider the maximization over the set of admissible strategy W2 where 

W2 = {w ^ W2 ■ 01,92 are exit imes from an interval in X}, 

and can use the relation 62 — 61 = 6 o s{6i) with some exit time 6 ^ S. 



q'-'^\x) = sup E"^ 



/•oo 

Jo 



6*2 



P rt/i rti2 roo 

sup E^ / e-'''f{Xs)ds+ / e-'''f{Xs)ds+ / e-'^'f{Xs)ds 

- e-"^i {H{Xe,_ , 0) + e-^^'^-'-^ H{Xe,_ , 1)) 



sup E^' / e-'''f{Xs)ds + e-''^'E^Oi 
-e-'''^H{Xe,_,0) . 



+ / ) e-"V(X,)ds - e-"'^i7(Xe_, 1) 

J9 
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Now by using the result for p^^^ , we can conclude 

= sup [ e-'''fiX,)ds + e-'^'^ (p^'^Xe,) - H{X0,_,O)) 

= sup \ r e-'''f{Xs)ds + e-"''! {yi{Xe,) - H{Xe,_,Q)) \ = W2i, 
6*1 e5 Uo 



Similarly, we can prove y2ix) = p^'^\x) and we can continue this process inductively to conclude that 

Wn{x) = q^^^\x) and yn{x) = p^'^\x) for all x and n. □ 

Lemma 2.2. For all x G M, lim„_»oo q^'^\x) = vi{x) and lim„_>oo (x) = vq{x). 

Proof. Let us define q{x) = lim„_KX) q^'^\x). Since W„ C W, q^'^\x) < vi{x) and hence q{x) < vi{x). 
To show the reverse inequahty, we define W'^ to be a set of admissible strategies such that 



{w eW : Ji{x) < oo for all x G 



Let us assume that vi (x) < +00 and consider a strategy w'^ G W'^ and another strategy Wn that coincides 
with w'^ up to and including time 6^ and then takes no further interventions. 



jr^{x)-jr{x) 

which implies 



e— (/(X,)-/(X,_,J)- J2 e-^''H{Xe,-,Q 

i>n+l 



(2.11) 



\Jf {x)-J'^{x)\<W 



a 



i>n+l 



As n — >^ +00, the right hand side goes to zero by the dominated convergence theorem. Hence it is shown 

vi{x) = sup Ji{x) = sup Ji{x) 

W^W+ W&JnWn 

so that vi{x) < q{x). Next we consider vi{x) = +00. Then we have some m G N such that Wm{x) = 
q(rn) _ ^ Hence (7*^") (x) = 00 for all n>m. The second assertion is proved similarly. □ 

We define an operator £ -.H —i-H where 7i is a set of Borel functions 

Cu{x) =supE'' [ e-'^'f{Xs)ds + e-'^^{u{Xr)-H{Xr-,l-Zr-)) 



Lemma 2.3. The function w{x) = lim„_>oo w^n(ic) is the smallest solution, that majorizes gi{x), of the 
function equation w = Cw. 

Proof. We renumber the sequence {wo,yi,W2, y-s---) as (uo,ui,U2,U3....). Since u„ is monotone increas- 
ing, the limit u{x) exists. We have Un+i{x) = Cun{x) and apply the monotone convergence theorem 
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by taking n ^ oo, we have u{x) = Cu{x). We assume that u'{x) satisfies u' = Cu' and majorizes 
gi{x) = uq{x). Then u' = Cu' > Cuq = ui. Let us assume, for induction argument that u' > Un, then 



u 



Cu > Cur 



Hence we have u! > Un for all n, leading to u' > lim„_^ 
{wo, yi,W2,y3--.-) to complete the proof. 



Un+l- 



u. Now we take the subsequence in 

□ 



Proposition 2.1. For each x G M, lim„_^oo = vi{x) and lim^^oo (a;) = vq{x). Moreover, the 

optimal switching times, 9^ are exit times from an interval. 

Proof. We can prove the first assertion by combining the first two lemmas above. Now we concentrate on 
the sequence of Wn{x). For each n, finding Wn{x) by solving (12.71 ) is an optimal stopping problem. By 
Proposition IA.4I the optimal stopping times are characterized as an exit time of X from an interval for all 
n. This is also true in the limit: Indeed, by Lemma 1231 in the limit, the value function of optimal switching 
problem ^1(2;) = w{x) satisfies w = Cw, implying that vi{x) is the solution of an optimal stopping 
problem. Hence the optimal switching times are characterized as exit time from an interval. □ 



2.2 Characterization of the value functions 



We go back to the original problem (12.31 ) to characterize the value function of the optimal switching prob- 
lems. By the exit time characterization of the optimal switching times, 9* are given by 



inf{t >0i_i;Xi eTi} 
inf{t>^,_i;XOGro} 



(2.12) 



where Fi = M \ Ci and Fq = M \ Cq. We define here Cj and Fj to be continuation and stopping region for 
XI, respectively. We can simplify the performance measure considerably. For Qq = l,sNe. have 



/ e-^^f{Xs)ds - e-'-'^HiXe^, , Cj) 

/•OD 



i=2 



e-"'/(Xs)(is + e-"^iE^si 



e-^'f{Xs)ds - e-^'^H{Xg^_ , Q 



e-'''^H{Xe,-,0) 
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We notice that in the time interval (0, 9i), the process X is not intervened. The inner expectation is just 
Jq^Xq^). Hence we further simplify 



= W 
= W 



e-'''f{Xs)ds + e-'^'^iJ^iXe,) - H{Xe,-,0)) 

-e-"'^gi{Xe,) + e-^'^ {J^ {Xe,) - H{Xe,-,0))] + gi{x) 
-e~''''gi{Xe,) + e-"''J^{Xe,)\ +gi{x). 



The third equality is a critical observation. Finally, we define ui = Ji — gi and obtain 

ui{x) = Jf{x)-gi{x) = \e-^'-'ui{Xe,) . 



(2.13) 



Since the switching time 9i is characterized as a hitting time of a certain point in the state space, we can 
represent 6i = Ta = ini{t > : Xt = a} for some a G M. Hence equation (12.131 ) is an optimal stopping 
problem that maximizes 

ui (x) = Jr {x)-gi (x) = [e-""-^ ui{XrJ] . (2.14) 
among all the € S. When = (i.e., x = Xq-^), 



and hence 



Jr(x) = [-51 (x) + Jo"(x) - H{x,0)] + 



ui{x) = J^ix)-Hix,0)-giix). 



In other words, we make a switch from open to closed immediately by paying the switching cost. Similarly, 
for C,Q = 0, we can simplify the performance measure Jq{-) to obtain 

J^{x)=¥.- [-e-'''^g^{Xe,) + e-^'^J^{Xe,)\ +g^{x). 

By defining uq = Jq — go, we have 

uo{x) = Jl^{x)-g^{x)=W 
Again, by using the characterization of switching times, we replace 9i with T},, 

no(x) = Jo"'(x) - 5o(x) = E" [e-'^-'^uoiXr,)] . (2.15) 

In summary, we have 

uq{x) + gQ{x) - H{x,Q) - gi{x), x G Ti, 



UQ{Xg^) 



ui{x) 



W [e-"-«ni(X,J] = E- [e"--" (^.q (^r J + 5o(X,J - 51 (X.J - H{Xr^,m , 2; e Ci, 

(2.16) 
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and 



^0(2;) 



[e'^-^Uf,{XrJ\ = W [e-"-''(^i(^rJ + 5l(^rJ - 5o(^rJ - H{Xr,, 1))] , x G Co, 
ui{x) + gi{x) - H{x,l) - gQ{x), X G To. 

(2.17) 



Hence we should solve the following optimal stopping problems simultaneously: 

Now we let the infinitesimal generators of and be ^1 and Aq, respectively. We consider {Ai — 
a)v{x) = for i = 0,1. This ODE has two fundamental solutions, and We set is 

an increasing and </?i(-) is a decreasing function. Note that Vi(c+) = 0, (/9j(c+) = 00 and Tpi{d—) = 
00, ipi{d—) = 0. We define 

Fi{x) = — -- and Gi[x) = — — - for ^ = 0, 1. 

(pi[x) ^i(x) 

By referring to Dayanik and Karatzas (|2003h . we have the following representation 

for x G [Z, r] where n = inf{t > 0; = /} and = inf{t > 0; = r}. 
By defining 

W^i = (^^iM) o and 1^0 = (noM) o Fq-i, 

the second equation in (12.16b and the first equation in (12.171 ) become 

W,{G,{x)) = W,{G,{a) f/f] - + W,{GM f'^"], ~ ^'f] xG[a,rf), (2.19) 

Gi [d] - Gi (a) Gi (d) - Gi (a) 

and 

TOH^H-of^oMllll^.TO))!!^. ..(C. (2.20, 

respectively. We should understand that Fo(c) = Fo(c+) = ^o(c+)/(/3o(c+) = and that Gi{d) = 
) = —ipi{d—)/'4}i{d—) = 0. In the next subsection, we shall explain Wi{Gi{d—)) and Wq{Fq[c+)) 
in details. Both Wi and l^o are a linear function in their respective transformed spaces. Hence under the 
appropriate transformations, the two value functions are linear functions in the continuation region. 



2.3 Direct Method for a Solution 

We have established a mathematical characterization of the value functions of optimal switching problems. 
We shall investigate, by using the characterization, a direct solution method that does not require the recur- 
sive optimal stopping schemes described in section 12.11 Since the two optimal stopping problems ( 12.181 ) 
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have to be solved simultaneously, finding uq in x G Cq, for example, requires that we find the smallest 
Fo-concave majorant of {ui{x) + gi{x) — go{x) — H{x, l))/ipo{x) as in (12.171 ) that involves ui. 

There are two cases, depending on whether x G Ci n Cq or x G Ti n Cq, as to what ni(-) represents. 
In the region x G Fi n Co, ui{-) that shows up in the equation of uo{x) is of the form ui{x) = uo{x) + 
go{x) — H{x, 1,0) — gi{x). In this case, the "obstacle" that should be majorized is in the form 

ui{x) +gi{x) - goix) - H{x, 1) 

= {uo{x) +go{x) - H{x,0) - gi{x)) + gi{x) - go{x) - H{x,l) 

= uo{x) - H{x, 0) - H{x, 1) < no(x). (2.21) 

This implies that in x G FinCo, the uo{x) function always majorizes the obstacle. Similarly, in x G FonCi, 
the ui{x) function always majorizes the obstacle. 

Next, we consider the region x G Cq n Ci. The no(-) term in (12.161 ) is represented, due to its linear 
characterization, as 

WoiFoix)) = Pomx)) + do 

with some /3o G M and do G M+ in the transformed space. (The nonnegativity of do will be shown.) In 
the original space, it has the form of ipo{x){PoFo{x) + do)- Hence by the transformation (ui/V'i) o G^^, 
Wi{Gi{x)) is the smallest linear majorant of 

Ki{x) + ipo{x){(3oFo{x) + do) _ Ki{x) + Poipojx) + dpipoix) 
V'i(x) ^pl{x) 

on {Gi{d-),Gi{a*)) where 

Kiix)^goix)-giix)-Hix,0). (2.22) 
This linear function passes a point ), Id) where Gi{d—) = and 

{Ki{x) + PoMx) + doMx))^ 
Id = limsup — . 

Let us consider further the quantity Id > 0. By noting 

{Kijx) + PoMx))^ ^ r (Kiix) + Mo{x) + doMx))+ 

nm sup r~r^ — ^™ 



{Ki{x) + Poi^oix))'^ , ,. doipoix) 
< lim sup 1- nm sup — —rT 

xid Wi{x) x-^d Vi{x) 

^d. ^1 {x) 



and lim sup^t^ m'' ~ ^' '^^ redefine Id by 



, A {Kijx) + f3oMx))+ 

Id = lim sup — (2.23) 

to determine the finiteness of the value function of the optimal switching problem, fi(x), based upon Propo- 
sition |A3]|A]7] Let us concentrate on the case Id = 0. 
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Similar analysis applies to (12.171) . ui (x) in (12.171 ) is represented as 



WiiGiix)) = f3iGi{x) + di 

with some /3i G M and di G M+. Note that di = > 0. In the original space, it has the form of 
ipi{x){/3iGi{x) + di). Hence by the transformation {uo/ipo(x)) o F^^, Wo{Fq{x)) is the smallest linear 
majorant of 

Kojx) + Mx)iPiGiix) + di) ^ Kojx) - Pi^ijx) + dMx) 
ifoix) ifoix) 

on (Fo(c+),Fo(fe*)) where 

Koix)^gi{x)-go{x)-H{x,l). (2.24) 
This linear function passes a point (Fo(c+), Ic) where Fq{c+) = and 

Hence we have Ic = do > 0. By the same argument as for Id, we can redefine 

. . (Ko(x)-/3iyi(x))+ 
ic = lim sup -— . (2.25) 

xlc V0{X) 

Remark 2,1, (a) Evaluation of 1^ or 1^ does not require knowledge of (Sq or Pi, respectively unless the 
orders of max{Ki{x) , ipi{x)) and ipo{x) are equal, for example. (For this event, see Proposition 12.41 ) 
Otherwise, we just compare the order of the positive leading terms of the numerator in (12.231) and 
(12.251 ) with that of the denominator. 

(b) A sufficient condition for Id = Ic = 0: since we have 

< trf < lim sup -— h iim sup ■ 



a sufficient condition for /^^ = is 



Similarly, 



limsup — —— — = and limsup , , , = 0. (2.26) 



< tc < lim sup h lim sup ■ 



xlc V'OW xlc V0{X) 

Hence a sufficient condition for /c = is 

(Ko(x))+ 

nmsup — = and limsup — -— = 0. (2.27) 

xlc foix) xlc foix) 

Moreover, it is obvious f3i < and Pq > since the linear majorant passes the origin of each 
transformed space. Recall a points in the interval (c, d) G M+ will be transformed by G(-) to 

{G{c),G{d-)) G M_. 
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We summarize the case of lc = ld = 0: 

Proposition 2.2. Suppose that Id = Ic = 0, the quantities being defined by l \2.23i and by f l2.25D . respectively. 
The value fimctions in the transformed space are the smallest linear majorants of 

>/'.(Gr'(0) ^' MF„-'i-)) 

where 

ri{x) = go{x) - gi{x) + P(,^o{x) - H{x,0) 

and 

ro{x) = gi{x) - go{x) - - H{x, 1) 

for 

/3o > and Pi < 0. (2.28) 
Furthermore, Ti and Fq in H2.16i and H2. 1 71 ) are given by 

Ti 4 {x G (c,d) : t^i(Gi(x)) = i?i(Gi(x))}, and Tq = {x G (c, d) : l^o(i^o(x)) = Rq{Fq{x))}. 

Corollary 2.1. If either of the boundary points c or d is absorbing, then (-Fq (c) , Wq (Fq (c) ) or (Gi (d) , M^i (Gi (d) ) ) 
is obtained directly. We can entirely omit the analysis of Ic or Id- The characterization of the value function 
(12.191 ) and (12.201 ) remains exactly the same. 

Remark 2.2. An algorithm to find (a*, 6*, /3q, can be described as follows: 

1. Start with some (3[ £ R. 

2. Calculate tq and then Rq by the transformation Ro{-) = ^"^^^-i^^^y 

3. Find the linear majorant of Rq passing the origin of the transformed space. Call the slope of the linear 
majorant, Pq and the point, Fo(5), where Rq and the linear majorant meet . 

4. Plug b and /5o in the equation for ri and calculate Ri by the transformation -Ri(-) = y^^try^. 

5. Find the hnear majorant of Ri passing the origin of the transformed space. Call the slope of the linear 
majorant, /3i and the point, Gi{a), where Ri and the linear majorant meet. 

6. Iterate step 1 to 5 until Pi = P[. 

If both Ri and Rq are differentiable functions with their respective arguments, we can find (a*, b*) analyti- 
cally. Namely, we solve the following system for a and b: 



dRojy) 

dy 

dRijy) 

dy 



{Fo{b) - Foic)) = R^{Fo{b)) 
y=mb) (2 29) 

(Giia) - Gi{d)) = Ri{Gi{a)) 

y=Gi(a) 



where '^^J^^ 



y=Fo(b*) 



/3oand^ ^^=Pl. 

^ y=Gi{a*) 
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Once we find Wi{-) and Wo{-), then we convert to the original space and add back gi{x) and go{x) 
respectively so that vi{x) = 'il^i{x)Wi{Gi{x)) + gi{x) and ^0(2;) = (Po{x)Wq{Fo{x)) + go{x). Therefore, 
by (12.161 ) and (12.171 ). the value functions vi{-) and vo{-) are given by: 

Proposition 2.3. If the optimal continuation regions for both of the value functions are connected and if 
lc = 1(1 = 0, then the pair of the value functions vi (x) and vq (x) are represented as 

X < a*, 
a* < X, 

X < b*, 
b* < X, 

for some a*,b* G M with a* < b*. 

Proof. If the optimal continuation regions for both of the value functions are connected and if Id = lc = 0, 
then the optimal intervention times (12.301 ) have the following form: 

ei={ ^ ' ^ ^ (2.30) 

|^inf{t > Oi^i^Xt i (c, 6*)}, Z = 0. 

Indeed, since we have Ic = Id = 0, the linear majorants Wi{-) and VFo(-) pass the origins in their respective 
transformed coordinates. Hence the continuation regions shall necessarily of the form of (12.301 ). 

By our construction, both vi{x) and vo{x) are continuous in x G M. Suppose we have a* > b*. In this 
case, by the form of the value functions, vo{b—) — H{b, 1, 0) = vi (6). Since the cost function H{-) > and 
continuous, it follows vo{b—) > vi{b). On the other hand, ^0(6+) = vi{b) — H{b, 0, 1) implying ^0(6+) < 
^1(6). This contradicts the continuity of vo{x). Also, a* = b* will lead to ^1(2;) = vi{x) — H{x, 1, 0) which 
is impossible. Hence if the value functions exist, then we must necessarily have a* < b*. □ 

In relation to Proposition 12.31 we have the following observations: 
Remark 2.3. (a) It is obvious that 

vo{x) = vo{x) > vo{x) — H{x, 0) =vi{x), x e (c, a*), 

and 

vi{x) = vi{x) > vi{x) — H{x, 1) = ^0(2;), X G {b*,d). 

(b) Since ui{x) is continuous in (c, d), the "obstacle" ui{x) + gi{x) — go{x) — H{x, 1) to be majorized 
by uo{x) on X G Co = (c, 6*) is also continuous, in particular at x = a*. We proved that uo{x) 
always majorizes the obstacle on (c, a*). Hence F{a*) G {y : Wo{y) > Ro{y)} if there exists a 
linear majorant of Ro{y) in an interval of the form (Fo(g), FQ^d)) with some q G (c, d): otherwise, 
the continuity of ui{x) + gi{x) — go{x) — H{x, 1) does not hold. Similarly, we have F{b*) G {y : 
Wi (y) > Ri {y)} if there exists a hnear majorant of Ro{y) in an interval of the form (Gi (c), Gi (q)). 



vi{x) 



vo{x) - H{x,0), 

vi{x) ^ Mx)Wi{Gi{x)) + gi{x), 



and 



vo{x) 



vo{x) = ipQ{x)Wo{Fo{x)) +go{x) 
vi{x) - H{x, 1), 
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Finally, we summarize other cases than Ic = Id = 0- 



Proposition 2.4. 

(a) If either 1^ = +oo or = +oo, then vi{x) = vq{x) = +co. 

(b) If both Id and Ic are finite, then Id = h = 0. 

Proof, (a) The proof is immediate by invoking Proposition IA.5I (b) When 1^ is finite, we know by Proposi- 
tion lA.5l that the value function vo{x) is finite. On x G (c, a*), ui{x) + gi{x) — go{x) — H{x, 1) < uo{x) < 
+00 is finite (see (12.211) ) and thereby 

Ic = lim sup — = 0. 

xlc ^0{X) 

The same argument for Id = 0. □ 

Therefore, we can conclude that Id = for the situation where the orders of m.ax{Ki{x),'>pi{x)) and tpoi^) 
are equal (=^ Id is finite) as described in Remark |2?T] (a). 



3 Examples 



We recall some useful observations. If h{-) is twice-differentiable at x G T and y = F{x), then we define 
H{y) = /i(F^-'^(y))/(/?(F^-'^(y)) and we obtain H' [y) = m(x) and H" (y) = m (x) / F' (x) with 



mix} 



F'ix) \ip 



h 



and H {y){A - a)h{x) > 0, y = F{x) 



(3.1) 



with strict inequality if H" (y) ^ 0. These identities are of practical use in identifying the concavities of 
H{-) when it is hard to calculate its derivatives explicitly. Using these representations, we can modify (12.291 ) 
to 



P^fe)'W(i^o(6)-Fo(c)) = g§ 



(3.2) 



Example 3.1. Brekke and 0ksendal (1 19941) : We first il lustrate our solution method by using a resource 
extraction problem solved by Brekke and 0ksendal (1 19941 ). The price Pt at time t per unit of the resource 
follows a geometric Brownian motion. Qt denotes the stock of remaining resources in the field that decays 
exponentially. Hence we have 

dPt = aPtdt + pPtdWt and dQt = -XQtdt 

where a, (3, and A > (extraction rate) are constants. The objective of the problem is to find the optimal 
switching times of resource extraction: 



v{x) = sup J'^(x) = sup 



POD 

/ e-P\XPtQt - K)Ztdt - V e-P'^H{Xe^_, Z^J 
Jo , 
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where rho £ M+ is a discount factor with p > a, K £ M_(_ is the operating cost and H{x, 0) = C G 
and H{x, 1) = L e are constant closing and opening costs. Since P and Q always show up in the form 
of PQ, we reduce the dimension by defining Xt = PtQt with the dynamics: 

dXt = (a- XZt)Xtdt + pXtdWt. 



Solution: (1) We shall calculate all the necessary functions. For Zt = 1 (open state), we solve (^i 

1 

2 



p)v{x) = where Ai = {a — \)xv'{x) + ^/^^^^^"(x) to obtain il)i{x) = x^+ and i^iix) = x'^- where 



i/+ _ = ( -a + A + ± ./(a - A - i/32)2 + 2p^2 j _ similarly, for Zt = (closed state), we solve 



(^0 — p)v{x) = where ^0 = axv'{x) + ^P'^x'^v" (x) to obtain i^oix) = x'^+ and ipo{x) = x^- where 
= (^—a + i/?^ lb Y^(a — \(5'^Y + "^PP"^^ ■ Note that under the assumption /? > a, we have 
, /i+ > 1 and , z/_ < 0. 



By setting Ai = ^J {a - A - i/32)2 + 2p/32 and Aq = ^J{a - i/32)2 + 2pf3^, we have Gi(x) = 
-yDi{x)/i!i{x) = -x-2^i//3' andFo(x) = i)o{x)/^o{x) = x^^o//^'. It follows that G^^(y) = (-y)~^'/2Ai 
and FQ"^(y) = y^^/2^0 this problem, we can calculate gi{x),go{x) exphcitly: 

X K 



5i(x) =E^ 



/>oo 

Jo 



and = 0. Lastly, Ki{x) = go{x) - gi{x) - H{x,0) = - (^+f3^ - f ) - C and Ko{x) 

9i{x) - go{x) - H{x, 1) = -f-L. 



p + X — a 

X 

p+X—a p 



(2) The state space of X is (c, d) = (0, 00) and we evaluate 1^ and l^. Let us first note that Aq — Ai + A > 0. 

(x) Aq-Ai + A 

Since lim^.|o = ^i^n^iox 1^ = and lim^io{Ko{x))+ /ipo{x) = 0, we have = = by 



(po{x) 

-(An-Ai + A) 



(12.271 ). Similarly, by noting lim^.i-+oo l^jfy = lim^ri+oo a; = and lim^^+oo{Ki{x))^ /ipo{x) 

0, we have 1^ = l+oo = by ( 12.261 ). 



(3) To find the value functions together with continuation regions, we set 

/ X K\ ( X K\ 

r\{x) = -\ — — \-C + Mq{x) and ro(x) = — — -L-/3i99i(x) 

\p + A-a p) \p + A-a p) 

and make transformations R\{y) = ri{F~^ {y)) /ijji{F~^ (y)) and Ro{y) = ro{F~^{y))/tpQ{F~^{y)), re- 
spectively. We examine the shape and behavior of the two functions Ri{-) and Ro{-) with an aid of (13.11 ). 
By calculating {ro/ipoYlx) explicitly to examine the derivative of Ro{y), we can find a critical point x = q, 
at which Rq(F{x)) attains a local minimum and from which R(){F{x)) is increasing monotonically on 
(Fo(g), cxd). Moreover, we can confirm that Hniy^oo R'oiy) = liniai^oo ^'^"f'(1)^^'^ = 0' which shows that 
there exists a finite Unear majorant of Ro{y). We define 

p{x) = piux"- -ip-a) (—^ ) +{K + pL) 

\p + X - a J 

such that (^0 — p)ro{x) = p{x) where u) = [p — ^P'^i'^{iy^ — 1) — au^) = ^{Aq — Ai + A)(Ao + 
Ai — A) > 0. By the second identity in (13.11 ). the sign of the second derivative Rgiy) is the same as the sign 
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of p{x). It is easy to see that p{x) has only one critical point. For any /?i < 0, the first term is dominant as 
2; — > 0, so that liuixio p{x) < 0. As x gets larger, for sufficiently small, p{x) can take positive values, 
providing two positive roots, say x = ki, k2 with ki < k2. We also have \iva.x-^+ooP{x) = — cxd. In this 
case, -Ro(?/) is concave on {{),F{ki) U (F(A;2), +cx)) and convex on (F{ki), F{k2)). Since we know that 
Ro{y) attains a local minimum at y = F{q), we have q < k2, and it implies that there is one and only on 
tangency point of the linear majorant W{y) and Ro{y) on iF{q), 00), so that the continuation region is of 
the form (0,6*). 

^From this analysis of the derivatives of Roiy), there is only one tangency point of the linear majorant 
Wo{y) and Ro{y). (See Figure [3TT] -(a)). A similar analysis shows that there is only one tangency point of 
the linear majorant Wi{y) and Ri{y). (See Figure iBTI -fb)). 



R(F(.),W(F(.)) R(G(.),W(G(.)) 




(c) (d) 

Figure 1: A numerical example of resource extraction problem, with parameters {a, (3, X, p, K, L,C) = 
(0.01, 0.25, 0.01, 0.05, 0.4, 2, 2)(a) The smallest linear majorant M/o(-Fb (a;)) and Ro{Fo{x)) with &* = 1.15042 and 
(3^ = 10.8125. (b)The smallest lineal- majorant 1^1 (Gi (a;)) and i?i(Gi(x)) with a* = 0.18300 and /?* = -0.695324. 
(c) The value function vo{x). (d) The value function vi{x). 



(4) By solving the system of equations (I2.29I ). we can find (a*, b*, Pq, P^). We transform back to the original 
space to find 

vi{x) = M^)Wi{Gi{x)) + gi{x) = Vi(x)/3i*Gi(x) + gi{x) 

X K 



-I3l^i{x)+gi{x) = -(3lx''- + 



p + X — a p 
and 

vo{x) = Mx)Wo{Fo{x)) + go{x) = Mx)P^Fo{x) + go{x) = p^Mx) + go{x) = P^x''+ . 
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Hence the solution is 



vi{x) 



X < a* , 



f), x>a', 



vo{x) 



X < b*, 
f)-L, x>b*, 



which agrees with Brekke and 0kesendal (119941) . 



Example 3.2. Ornstein-Uhrenbeck process: We shall consider a new problem involving an Omstein- 
Uhrenbeck process. Consider a firm whose revenue solely depends on the price of one product. Due to its 
cyclical nature of the prices, the firm does not want to have a large production facilty and decides to rent 
additional production facility when the price is favorable. The revenue process to the firm is 

dXt = 6{m -Xt- \Zt)dt + adWt, 

where X = r/d with r being a rent per unit of time. The firm's objective is to maximize the incremental 
revenue generated by renting the facility until the time tq when the price is at an intolerably low level. 
Without loss of generality, we set tq = inf{t > : = 0}. We keep assuming constant operating cost K, 
opening cost, L and closing cost C. Now the value function is defined as 



v{x) = sup J'^{x) = sup 



e-"*(Xt - K)Ztdt - e-'^'^HiXe^., Zq 



i<TO 



Solution: (1) We denote, by ip{-) and the functions of the fundamental solutions for the auxiliary 
process Pt = (Xt — m + X)/a,t > 0, which satisfies dPt = —6Ptdt + dWt- For every x G M, 

^(x) = e^''^/^V_^/s{-xV26) and >f{x) = e^'''^'^V_^/sixV25), 

which leads to ipiix) = ip{{x — m + A)/cr), (pi{x) = ip{{x — m + A)/cr), i)Q{x) = -(^((x — m)/a), and 
'^o{x) = (p{{x — m)/a) where 'Dy{-) is the parabolic cylinder function; (see Borodin and Salminen (2002, 
Appendices 1.24 and 2.9) and Carmona and Dayanik (2003, Section 6.3)). By using the relation 



in terms of the Hermite function Tiy of degree v and its integral representation 

1 



t'^-^^dt, Re{iy) < 0, 



(3.3) 



(3.4) 



(see for example, Lebedev(1972, pp 284, 290)). Since E^[Xt] = e'^^x + (1 - e-^*)(m - A), we have 
goix) = and 51 (x) = ^-^^ + 

(2) The state space of X is (c, d) = (0, +00). Since the left boundary is the absorbing, the linear majorant 
passes (0, Fo{0)). Since lim^.^+00 V^o(x)/V'i(x) = 0, we have 1^ = 0. 
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(3) We formulate 



/X ,^-(m-A) m-A - K\ ^ r, , , ^ 

rxix) = - '- + - C + Mq{x) 

+ a a 



and 

/x— (m — A) m — A — K\ ^ ^ 
\ + a a J 

and make transformations: Ri{y) = ri(F~^(y))/-(/'i(i^~"^(y)) and -Ro(y) = foiF'^iv)) / VaiF'^^iu))^ 
respectively. We examine the shape and behavior of the two functions -Ri(-) and Rq{-) with an aid of (I3.1I ). 
First we check the sign of R'Q{y) and find a critical point x = q,a.t which i?o(F(x)) attains a local minimum 
and from which Ro{F{x)) is increasing monotonically on {FQ{q), oo). It can be shown that R'q{+oo) = 
by using and and the identity n'^{z) = 2unu-i{z),z £ R (see Lebedev (1972, p.289), for 
example.) This shows that there must exist a (finite) linear majorant of Ro{y) on (F(g),oo). To check 
convexity of Ro{y), we define 

P{x) = -^-^'f'iix) + S{m - X - A) (y-^ f3iip[(x)] - aro(x) 

2 \o + a / 

such that ~ o.)'''o{x) = p{x). We can show easily lim.j.^j^coP{^) = — oo since (/?i(+oo) = ip[{+oo) = 
(/?'/(+cxd) = 0. Due to the monotonicity of ipi{x) and its derivatives, p{x) can have at most one critical point 
and p{x) = can have one or two positive roots depending on the value of f3i. In either case, let us call the 
largest positive root x = k2. We also have limx^-\-ooP{x) = — oo. Since we know that Ro{y) attains a local 
minimum at y = F{q) and is increasing thereafter, we have q < k2. It follows that there is one and only on 
tangency point of the linear majorant W{y) and Ro{y) on {F{q), oo), so that the continuation region is of 
the form (0, b*). A similar analysis shows that there is only one tangency point of the linear majorant Wi (y) 
and Ri{y). 

(4) Solving (I3.2I ). we we can find (a*, 6*, /?q, /?^). We transform back to the original space to find 

vi{x) = M^WiiGiix)) + giix) = M^)PlGiix) + 9iix) = -p^x) + gi{x) 



and 



^, . / (x — m + X)V26\ X — (m — X) m — X 
-file 2.^ V_^,s ^ + }- + 



vq{x) = ifQ{x)Wo{FQ{x)) + go{x) = (^o(x)/3o*(i"o(x) - Fo(0)) + g^ix) 
= /3o*{^o(x) - Fo(0)(^o(x)} + 5o(x) 



Hence the solution is, using the above functions, 

vx(x) -- 

See Figure [3]2] for a numerical example. 



vq{x) - C, X < a , 

vq(x) 

v\{x), X > a*, 



{)o(x), X < b*, 

vi{x) — L, X > b*. 
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vO(x) vl(x) 
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0.5 1 1.5 2 2.5 3 0.5 1 1.5 2 2.5 3 

(a) (b) 

Figure 2: A numerical example of leasing production facility problem with parameters (m, a, cr, S, A, K, L, C) = 
(5,0.105,0.35,0.05,4,0.4,0.2,0.2): (a) The value function i;o(a;) with 6* = 1.66182 and = 144.313. (b)The 
value function vi{x) with a* = 0.781797 and f]^ = -2.16941. 



4 Extensions and conclusions 



4.1 An extension to the case of A; > 2 

It is not difficult to extend to a general case of k > 2 where more than one switching opportunities are 
available. But we put a condition that z e Z is of the form z = (ai, 02, a/c) where only one element of 
this vector is 1 with the rest being zero, i.e., z = (0, 0, 0, 1, 0, 0) for example. 
We should introduce the switching operator Aio on h ^ H, 



AiQh{u,z)= max {h{u,Q — H{u, z;Q} . 
Cez\{z} 



(4.1) 



In words, this operator would calculate which production mode should be chosen by moving from the current 
production mode z. Now the recursive optimal stopping ( 12.71 ) becomes 



Wn+l{x) = SUpE^' 
re5 







Accordingly, the optimization procedure will become two-stage. To illustrate this, we suppose /c = 2 so that 
i = 0,1, and 2. By eliminating the integral in (14.11) . we redefine the switching operator, 



max {h^{x) + gi;{x) - g^{x) - H{x, z, ()} 



where 



Mh,{x) = 

g,{x) ^ sup J:{x) = 



(4.2) 



w€Wo 



/•oo 

/ e-"'f{X,)ds 
Jo 



Hence ( 12.131 ) will be modified to Uz{x) 
(12.181 ) is now 



E^'[e "''^ M-Uz{Xt-)]. It follows that our system of equations 



V2{x) = sup^e^E^ [e-''^Mv2{Xr)] 
vi{x) = sup^g^E^' [e-'^^Mvi{Xr)] 
vo{x) ^ sup.g^E^- [e-'^^MvoiXr)] 



(4.3) 
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The first stage is optimal stopping problem. One possibility of switching production modes is (0 — > 1, 1 — > 
2,2 — > 0). First, we fix this switching scheme, say c, and solve the system of equations (14.31 ) as three 
optimal stopping problems. All the arguments in Section 2.3 hold. This first-stage optimization will give 
{xq{c) , xl{c) , X2{c) , /3q (c), /3J(c), (c)), where Xi's are switching boundaries, depending on this switching 
scheme c. 

Now we move to another switching scheme c' and solve the system of optimal stopping problems until 
we find the optimal scheme. 



4.2 Conclusions 



We have studied optimal switching problems for one-dimensional diffusions. We characterize the value 
function as linear functions in their respective spaces, and provide a direct method to find the value functions 
and the opening and switching boundaries at the same time. Using the te chniqu es we developed here as 
well as the ones in Dayanik and Karazas (l2003b and Dayanik and Egami (l2005h . we solved two specific 
problems, one of which involves a mean-reverting process. This problem might be hard to solve with just 
the HJB equation and the related quasi-variational inequahties. Finally, an extension to more general cases 
is suggested. We believe that this direct method and the new characterization will expand the coverage of 
solvable problems in the financial engineering and economic analysis. 



A Summary of Optimal Stopping Theory 



Let {^,J^,F) be a complete probability space with a standard Brownian motion W = {Wt;t > 0} and 
consider the diffusion process with state pace X C M and dynamics 



dX^ = fi{X^)dt + a{Xf)dWt 



(A.l) 



for some Borel functions /i : X ^ M and a : T —^ {0,oo). We emphasize here that X^ is an uncontrolled 
process. We assume that X is an interval with endpoints — oo < a < b < +oo, and that X^ is regular in 
(a, b); in other words, X^ reaches y with positive probability starting at x for every x and y in (a, b). We 
shall denote by F = {J^t} the natural filtration generated by X^. 

Let a > be a real constant and /i(-) a Borel function such that E^[e~°'^/i(X°)] is well-defined for 
every F-stopping time r and x G X. Let Ty be the first hitting time of y G X by X^, and let c G X be a fixed 
point of the state space. We set: 



ip{x) 



X < c, 
X > c, 



ip{x) 



E^[e- 



■CtTc-l 



X > c, 



and 



F{x) 



ip{x)' 



x £l. 



(A.l) 



Then -F(-) is continuous and strictly increasing. It should be noted that ip{-) and (/?(•) consist of an increasing 
and a decreasing solution of the second-order differential equation {A — a)u = in X where A is the 
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infinitesimal generator of They are linearly independent positive solutions and uniquely determined 
up to multiplication. For the complete chara cteriza tion of ip{-) and (^(•) corresponding to various types of 
boundary behavior, refer to Ito and McKean (Il974t) . 

Let F : [c,d\ ^ M be a strictly increasing function. A real valued function u is called F-concave on 
[c, d] if, for every a < I < r < b and x G [/, r], 

^.^P{r)-F(x) , F(x)-Fil) 

We denote by 

V{x) ^ sup [e-"^/i(X°)] , X £ [c, d] (A.3) 

res 

the value function of the optimal stopping problem with the reward function h{-) where the supremum is 
taken over the class S of all F- stoppi ng times. Then we have the following results, the proofs of which we 
refer to Dayanik and Karatzas (l2003h . 

Proposition A.l. For a given function U : [c, d] [0, +00) the quotient U{-)/ip{-) is an F-concave function 
if and only if [/(•) is a-excessive, i.e., 

U{x) > E^'[e-"^C/(X°)],VT G cS,Vx G [c,d\. (A.4) 

Proposition A.l. The value function V{-) of (IA.3I ) is the smallest nonnegative majorant of h{-) such that 
V{-)/ip{-) is F-concave on [c,d]. 

Proposition A.3. Let l^(-) be the smallest nonnegative concave majorant of H = (h/ip) o F^^ on 
[F{c),F{d)], where F-'^{-) is the inverse of the strictly increasing function F(-) in ( IA.2I) . Then V{x) = 
ip{x)W{F{x)) for every x G [c, d]. 

Proposition A.4. Define 

5 = {x G [c, d] : V{x) = h{x)}, and r* = inf{t ^ : e S}. (A.5) 

If h{-) is continuous on [c, d], then r* is an optimal stopping rule. 

When both boundaries are natural, we have the following results: 

Proposition A.5. We have either V = Oin (c, d) or V{x) < +00 for all (c, d). Moreover, V{x) < +00 for 
every x G (c, d) if and only if 

Ic = iimsup — -— and = nmsup — (A. 6) 

xlc ^{X) x]d i^{x) 

are both finite. 

In the finite case, furthermore. 

Proposition A.6. The value function V{-) is continuous on (c, d). If /i : (c, d) — > M is continuous and 
lc = ld = 0, then r* of (IA.5I I is an optimal stopping time. 
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Proposition A.7. Suppose that Ic and Id are finite and one of them is strictly positive, and h{-) is continuous. 
Define the continuation region C = (c, d) \ T. Then r* of (IA.5I) is an optimal stopping time, if and only if 

there is no r G (c, d) such that (c, r) C C if Ic > and 
there is no / G (c, d) such that (/, d) C C if > 0. 
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